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DETAILED ACTION 
Response to Amendment 

1 . This office action is in response to the amendmeht filed on 27 November 2006. 

Response to Arguments 

2. Applicant's arguments with respect to claims 1-20 have been considered but are 
moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 1-20 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Philomin et al. (US 2003/0081 834) in view of Strubbe et al. (US 6,795,808). 

5. Regarding Claim 1 , Philomin et al teach a method for colleting and associating 
effective information for a plurality of images in an imaging system, comprising the steps 
of: (a) displaying a plurality of digital images for viewing by a particular user (presenting 
processed data signals to the display unit 24 for viewing) (page 2, paragraph [0021]); 
(b) automatically collecting affective information for the plurality of digital images as the 
particular user views the images (monitoring the emotion of the viewer) (page 2, 
paragraph [0022]); and (c) associating the collected affective image with the particular 
user (associating facial expressions associated with emotional states) (page 2, 
paragraphs [0022] and [0023]). 
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Philomin et al fail to teach a method for colleting and associating effective 
information for a plurality of images in an imaging system, comprising the step of: 
storing in a database the collected affective information for each of the plurality of digital 
images. 

Strubbe et al teach a method for colleting and associating effective information 
for a plurality of images in an imaging system, comprising the step of: storing in a 
database the collected affective information for each of the plurality of digital images 
(response data stored or conveyed in response data store 440) (col. 20, lines 55-67). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to have combined the teachings of Philomin with the teaching of 
Strubbe to store the affective information in a database for access at a later time. 

6. Regarding Claim 2, Philomin et al fail to teach a further including the step of: d) 
the particular user providing a personal identifier. 

Strubbe et al teach a method further including the step of: d) the particular user 
providing a personal identifier (user identifier 460) (col. 27, lines 13-29). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to have combined the teachings of Philomin with the teaching of 
Strubbe to require a user to identify themselves every time they access the digital 
images for trend analysis. 

7. Regarding Claim 3, Philomin et al fail to teach a method wherein the affective 
information and a user identifier are stored with the digital image in a digital image file. 
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Strubbe et al teach a method wherein the affective information and a user 
identifier are stored with the digital image in a digital image file (correlate historical data 
with particular users) (col. 27, lines 13-29). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to have combined the teachings of Philomin with the teaching of 
Strubbe to require a user to identify themselves every time they access the digital 
images for trend analysis. 

8. Regarding Claim 4, Philomin et al fail to teach a method wherein the digital 
image file includes affective information and user identifiers for a plurality of users. 

Strubbe et al teach a method, wherein the digital image file includes affective 
information and user identifiers for a plurality of users (different users) (col. 27, lines 13- 
29). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to have combined the teachings of Philomin with the teaching of 
Strubbe to allow a plurality of viewers access to the digital images for trend analysis. 

9. Regarding Claim 5 Philomin et al teach a method wherein the step of 
automatically collecting affective information includes monitoring the physiology of the 
user (monitoring the emotion of the viewer) (page 2, paragraph [0022]). 

10. Regarding Claim 6, Philomin et al teach a method wherein the step of 
automatically collecting affective uses a video camera (observation unit 12 may be an 
optical sensor, sound sensor, a video camera) (page 2, paragraph [0022]). 
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1 1 . Regarding Claim 7, Philomin et al teach a method wherein the step of 
automatically collecting affective information includes determining the duration of time 
the user views each of the plurality of images (facial expression of viewer for 
predetermined amount of time) (page 4, Claim 4). 

12. Regarding Claim 8, Philomin et al teach a method wherein the step of 
automatically collecting affective information for the plurality of digital images includes 
monitoring the gaze of the user (technique of detecting the emotional state of the 
viewer... contour of the eye) (page 3, paragraph [0028]). 

13. Regarding Claim 9, Philomin et al teach a method for providing affective 
information for images in an imaging system, comprising the steps of: a) sequentially 
displaying a plurality of digital images for viewing by a particular user (presenting 
processed data signals to the display unit 24 for viewing) (page 2, paragraph [0021]); b) 
automatically collecting affective information for each of the plurality of digital images 
(monitoring the emotion of the viewer) (page 2, paragraph [0022]); c) associating the 
collected affective information with the particular user (associating facial expressions 
associated with emotional states) (page 2, paragraphs [0022] and [0023]). 

Philomin et al fail to teach a method for providing affective information for images 
in an imaging system, comprising the steps of: c) storing the collected affective 
information for each of the plurality of digital images; and d) using the stored collected 
affective information to facilitate retrieval of particular digital images from the plurality of 
digital images. 
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Strubbe et al teach a method for providing affective information for images in an 
imaging system, comprising the steps of: c) storing the collected affective information 
for each of the plurality of digital images (response data stored or conveyed in response 
data store 440) (col. 20, lines 55-67); and d) using the stored collected affective 
information to facilitate retrieval of particular digital images from the plurality of digital 
images (mood/personality classifier correlated historical data with particular users) (col. 
7, lines 13-29). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to have combined the teachings of Philomin with the teaching of 
Strubbe to store the affective information in a database for access at a later time. 
14. Regarding Claim 10, Philomin et al fail to^ teach a method wherein the affective 
information for each of the plurality of digital images is stored along with the digital 
image in separate digital image files, and the digital image files include a user identifier 
which identifies the particular user. 

Strubbe et al teach a method wherein the affective information for each of the 
plurality of digital images is stored along with the digital image in separate digital image 
files, and the digital image files include a user identifier which identifies the particular 
user (correlate historical data with particular users) (col. 27, lines 13-29). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to have combined the teachings of Philomin with the teaching of 
Strubbe to require a user to identify themselves every time they access the digital 
images for trend analysis. 
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1 5. Regarding Claim 1 1 , Philomin et al teach a system for providing affective 
information for images in an imaging system, comprising: c) a display which sequentially 
displays the set of digital images for viewing by the particular user (presenting 
processed data signals to the display unit 24 for viewing) (page 2, paragraph [0021]); d) 
a sensor for automatically measuring the particular user's reaction to the image 
(observation unit 12) (page 2, paragraph [0022]); and e) a processor for processing the 
signal from the sensor to provide affective information for the set of digital images 
(control unit 16) (control unit 16 analyzes data from the observation unit 12) (page 2, 
paragraph [0023]). 

Philomin et al fail to teach a system for providing affective information for images 
in an imaging system, comprising: a) a digital memory which stores a set of digital 
images; b) means for identifying a particular user; and e) a memory for storing the 
affective information for the set of digital images, wherein the processor accesses the 
stored affective information to facilitate retrieval of particular digital images from the set 
of stored digital images. 

Strubbe et al teach a system for providing affective information for images in an 
imaging system, comprising: a) a digital memory which stores a set of digital images 
(database 430); b) means for identifying a particular user (user identifier 460) (col. 27, 
lines 13-29); and e) a memory for storing the affective information for the set of digital 
images (response data stored or conveyed in response data store 440) (col. 20, lines 
55-67), wherein the processor accesses the stored affective information to facilitate 
retrieval of particular digital images from the set of stored digital images 
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(mood/personality classifier correlated historical data with particular users) (col 7, lines 
13-29). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to have combined the teaching of Philomin with the teaching of Strubbe 
to require a user to identify themselves every time they access the digital images for 
trend analysis. 

16. Regarding Claim 12, Philomin et al teach a system wherein the sensor is a video 
camera (observation unit 12 may be an optical sensor, sound sensor, a video camera) 
(page 2, paragraph [0022]). 

17. Regarding Claim 13, Philomin et al teach a system wherein the processor 
processes the signal from the video camera in order to determine the user's facial 
expression (observation unit communicates with the control unit 16, which analyzes 
data from the observation unit 12) (page 1 , paragraph [0023]). 

18. Regarding Claim 14, Philomin et al disclose a system wherein the sensor 
measures the user's biometric response (facial expressions associated with emotional 
states) (page 2, paragraph [0022]). 

19. Regarding Claim 15, Philomin et al fail to teach a system, wherein the sensor 
measures the particular user's galvanic skin response. 

Strubbe et al teach a system, wherein the sensor measures the particular user's 
galvanic skin response (galvanic skin response sensor) (col. 21, lines 47-67, col. 22, 
lines 1-6). 
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Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to have combined the teachings of Philomin with the teaching of 
Strubbe to use a biometric sensor to monitor biological or physiological characteristics 
or responses of the viewer. 

20. Regarding Claim 16, Philomin et al fail to teach a system, wherein the system 
includes a pointing device, and the sensor is incorporated into the pointing device. 

Strubbe et al teach a teach a system, wherein the system includes a pointing 
device, and the sensor is incorporated into the pointing device (input user interface 400) 
(col. 20, lines 29-40). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to have combined the teachings of Philomin with the teaching of 
Strubbe to input information thru a user interface such as a mouse. 

21 . Regarding Claim 1 7, Philomin et al fail to teach a system, wherein the sensor 
measures the particular user's galvanic skin response. 

Strubbe et al teach a system, wherein the sensor measures the particular user's 
galvanic skin response (galvanic skin response sensor) (col. 21, lines 47-67, col. 22, 
lines 1-6). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to have combined the teachings of Philomin with the teaching of 
Strubbe to use a biometric sensor to monitor biological or physiological characteristics 
or responses of the viewer. 
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22. Regarding Claim 18, Philomin et al teach a system wherein the affective 
information is stored in the digital memory (facial expressions stored in the recognition 
module 14) (page 2, paragraph [0023]). 

23. Regarding Claim 19, Philomin et al fail to teach a system wherein the affective 
information is stored with each digital image in a digital image file. 

Strubbe et al teach a system wherein the affective information is stored with each 
digital image in a digital image file (response data stored or conveyed in response data 
store 440) (col. 20, lines 55-67). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to have combined the teaching of Philomin with the teaching of Strubbe 
to store a viewers emotional expressions for trend analysis. 

24. Regarding Claim 20, Philomin et al fail to teach a system wherein the digital 
image file includes affective information and user identifiers for a plurality of users. 

Strubbe et al teach a system wherein the digital image file includes affective 
information and user identifiers for a plurality of users (different users) (col. 27, lines 13- 
29). 

Therefore it would have been obvious to one of ordinary skill in the art at the time 
of the invention to have combined the teachings of Philomin with the teaching of 
Strubbe to allow a plurality of viewers access to the digital images for trend analysis. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Satwant K. Singh whose telephone number is (571) 
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272- 7468. The examiner can normally be reached on Monday thru Friday 8am - 
4:30pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Kimberly A. Williams can be reached on (571) 272-7471. The fax phone 
number for the organization where this application or proceeding is assigned is 57.1- 

273- 8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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Examiner 
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